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CN , Abstract 

A Ti completely regular space X is finite dimensional, locally com- 
pact and separable metrizable if and only if X has a finite basic family: 
functions <l>i, 4>„ such that for all / G C{X) there are g\, ...,gn G C(IR) 
satisfying f{x) = Yl"=\ 9i(,^i{x)) for aU x £ X. 
^ . This give the complete solution to four problems on basic functions 

' posed by Sternfeld. 

S: 

1 Introduction 

^ ' The 13th Problem of Hilbert's celebrated list [3] is usually interpreted as asking 

I whether every continuous real valued function of three variables can be written 

' as a superposition (i.e. composition) of continuous functions of two variables. 

I Kolmogorov gave a strong positive solution (we write C{X) for all continuous 

• ' real valued maps on a topological space X , and C* {X) for the subset of bounded 

I maps): 

OO . Theorem 1 (Kolmogorov Superposition, [6]) For a fixed n > 2, there are 

' n(2n+l) maps (ppq G C([0, 1]) such that every map f £ C([0, 1]") can be written: 

> 



2n+l n 
/(x) = ^ ($,(x)) where <^q{xi,...,Xn)^^(l)pq{Xp), 

?H ' 9=1 P=l 



and the gq G C(R) are maps depending on f . 

In addition to solving the superposition problem, Kolmogorov's theorem says 
that the functions $1, . . . , <i>2n+i from [0, 1]" to the reals form a finite 'basis' for 
all continuous real valued maps from [0, 1]". This is a very striking phenomena, 
leading to the following natural definition of Sternfeld [TT] : 
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Definition 2 Let X be a topological space. A family $ C C{X) is said to be 
basic (respectively, basic*J for X if each f G C{X) (respectively, C*{X)) can 



be written: f {g^o $^), 

q=l 

for some $i, . . . , in # and 'co-ordinate functions' f/i, . . . , g„ £ C(R). 

Beyond their intrinsic interest, basic functions have proved to be widely use- 
ful. Since the use of basic functions reduces calculations of functions simply 
to addition and evaluation of a fixed finite family of functions, applications to 
numerical analysis, approximation and function reconstruction are immediately 
apparent. But other applications have emerged including to neural networks 



Extending the Kolmogorov Superposition Theorem, Ostrand [9] showed that 
every compact metric space of dimension n has a basic family of size 2n + 1. 
Subsequently Sternfeld [TT] showed that this basic family is minimal in the sense 
that a compact metric space with a basic family of size no more than 2n + 1 must 
have dimension < n. Noting that Doss [T] had shown that Euclidean n-space, 
R", has a basic family of size 4n for n > 2, Sternfeld asked (in Problems 9-13 of 
exactly which spaces have a finite basic family, and whether the minimal 
size of a basic family on a space X was 2n + 1 where n = dim{X). Hattori [2] 
showed that every locally compact, separable metrizable space X of dimension 
n has a finite basic* family of size 2n + 1. He asked whether the restriction to 
locally compact spaces was necessary. Our Main Theorem below gives a strong 
and complete solution to all these problems. 

Since spaces with a finite basic family are finite dimensional, it seems plau- 
sible that spaces with a countable basic family would be countable dimensional. 
But we prove that if a space has a countable basic family, then some finite 
subcollection is also basic, and so the space is finite dimensional (and locally 
compact, separable metrizable). To facilitate the proof, and provide full gen- 
erality we make the following definition allowing more general superposition 
representations than a 'basic' representation. 

Definition 3 Let X be a topological space. A family $ C C{X) is said to 
be generating (respectively, generating* J for X with respect to a 'set of op- 
erations ' M of continuous functions mapping from subsets of Euclidean space 
into subsets of Euclidean space, if each f £ C{X) (respectively, C*{X)) can be 
written as a composition of functions from M and C(R). 

Note that a basic (respectively, basic*) family is generating (respectively, generating*) 
with respect to M = {-I-}, and clearly 'generating' implies 'generating*'. 

Theorem 4 (Main Theorem) Let X be Ti and completely regular. Then the 
following are equivalent: 

1) X has a countable generating* family with respect to a countable set of 
operations, 

2) X has a finite basic family, and 

3) X is a finite dimensional, locally compact and separable metrizable. 



n 




H [3 [7]. 
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Further, a locally compact separable metrizahle space X has dimension < n 
if and only if it has a basic family of size < 2n + I. 



'Further' claim characterizing dimension in Section [4l 

2 Restrictions Induced by Generating* Families 

In this section, aU topological spaces are Ti and completely regular. 

Lemma 5 Let X have a generating* family $ with respect to M. Then e : 
X M* defined by e{x) — ($(a::))$g# is an embedding. 

Proof. Clearly e is continuous (each projection is a $ in 4> which is con- 
tinuous). It is also easy to see e is injective. Take distinct x,x' in X. Pick 
/ G C*{X) such that f{x) = 0, f{x') = 1. Represent / as a composition of 
$1, ...,$„ in €>, members of M and C(R). If e{x) = e{x') then ^i{x) = ^i{x') 
for all i, and so f{x) = fi^'), which is a contradiction. 

It remains to show that the topology induced on X by e contains the original 
topology. Since X is completely regular it is sufficient to check that for every 



/ e C*{X) the map e(/) : e{X) R defined by e(/)(x) = /(e-i(x)) is 



continuous. But each / S C*{X) can be written as a composition of some 
in $ and members of M and C(R). Note that for each i we have 
$(e~^(x)) = 7r$;(x), where 7r$. is the projection map of R* onto the $ith co- 
ordinate. Hence e(/) = f o is the composition of continuous maps, namely 
the 7r$;S and functions in M and C(R), and so is continuous as required. ■ 

Since any subspace of R'^ is separable metrizable, and any subspace of E" 
is finite dimensional we deduce from Lemma (5] 

Corollary 6 

a) A space with a countable generating* family is separable metrizable. 

b) A space with a finite generating* family is finite dimensional. 

A subspace C of a space X is said to be C*-embedded in X if every / G 
C*(C) can be extended to a continuous bounded real valued function on X. In 
a normal space all closed subspaces are C*-embedded. Compact subspaces are 
always C*-embedded. We note the following easy lemma: 

Lemma 7 If ^ is a generating* family (respectively, basic* ) for a space X with 
respect to M, and C is C* -embedded in X then $|C = {$|C : $ G is a 
generating* (respectively, basic* ) family for C . 

Lemma 8 A space with a countable generating* family is locally compact. 




3 



Proof. Suppose the space X has a countable generating* family $ with 
respect to M, but is not locally compact. Since X is metrizable, it follows that 
the metric fan F (defined below) embeds as a closed subspace in X. Hence 
by Lemma [7] it suffices to show that F does not admit a countable generating* 
family (with respect to any set of operations M). 

The metric fan F has underlying set {*} U (N x N) and topology in which 
all points other than * are isolated and * has basic neighborhoods B{*,N) = 
{*} U {[N, oo) X N). For a contradiction, let <I> = {$i, $2, . . .} be a countable 
generating* family with respect to M. 

For each i, let yi = ^i{xo), and pick basic open Ui containing * such that 
^^iU^) C (yi - 1,2/1 + 1). Now for each n let 14 = ^X=lU^■ So $,(K) C 
(j/j - 1, ?/i + 1) for i = 1, . . . , n. We can write Vn — {*} U ([-/V„, 00) x N) and 
suppose, without loss of generality, that Nn > Nm if n > m. 

Fix n. Let D° = {x^ = {Nn,k) : fc e N}. As {$i(a;5?)}fcGN is a subset of 

— 1, j/i + l], which is sequentially compact, there is a D-^ — {xl : fc G N} C £)° 
such that {$i(a;^)}fcgN is convergent. As {^2ixl)}k£N is a subset of [7/2 — 1, 2/2 + 
1], which is sequentially compact, there is a = {x^^ : n G N} C such that 
{^2{xl)}k£N is convergent. Inductively we get £>" — {a;J! : k G N}, which is 
infinite closed discrete and for each i = l,...,n the sequence {^i{x2)}keN is 
convergent, say to . Define = {x^^-i -keN} and = {x^^, : A; G N}. 

Define / : — > [0, 1] by: / is identically zero outside IJ^^ Dq (in particular, 
/ is zero on each D^), and / is identically 1/n on Dq. Then / is continuous 
and bounded. 

Hence, for some m, / can be written as the composition of $1, ... , and 
members of M and C(K). Now, on the one hand linifc $i(x^._j^) = Zi,m = 
limfc ^i{x^f.) so by continuity of the elements of M and C(M) in the composi- 
tional representation of /, lim^ /(a;^_i) = linife /(a;^), and on the other hand, 
limfc f{x™i^_i) = 1/m 7^ = limfc f{x'!Jj^). This is our desired contradiction. ■ 

Let y be a locally compact separable metrizable space. Write Ck{Y) for 
C{Y) with the compact-open topology. Then Ck{Y) is a Pohsh (separable, 
completely metrizable) group. In particular, for any n, Cfc(M)" is a Polish 
group. 

Lemma 9 If X has a countable generating* family with respect to a countable 
set of operations, M , then X has a finite generating* family with respect to a 
finite set of operations M' . 

Proof. Let <I>i,$2, ■ • ■ be a countable generating* family for X with respect 
to the countable set of operations M. By Lemma [S]X is locally compact and 
Ck{X) is a Polish group. 

Let gi,g2, - ■ ■ be formal letters representing functions from R to R. Let W 
be the set of all formal compositions of 'I'iS, elements of M and giS. Note that 
yV is countable. 

Fix w in W. Then w induces a map (51, . . . , (/„) 1— > w{gi,...,gn) from 
Cfe(R)" — > Ck{X) where we substitute actual gi G C(R) for the corresponding 
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formal letter. This map is continuous with respect to the compact-open topol- 
ogy. Let F„ = w(Cfc(R)"). It is analytic. Define = n Cfe(X, (0, f )). 
Since Ck{X, (0, 1)) is homeomorphic to Ck{X) it is Pohsh, and hence must be 
a Gs subset of Gk{X). So G^ is analytic in Ck{X, (0, 1)). 

Note, by the generating* property, that C^X) C lj^,gyy F^,. Hence Ck{X, (0, 1)) = 
UtuGW Baire Category theorem there must be some particular w in 

W such that G^ is not meager. 

Fix a homeomorphism h : M — > (0, 1). Via h, addition and subtraction on 
R induce (continuous) group operations ©,G : (0,1) x (0,1) (0,1). These 
operations on (0, 1) in turn induce operations on Ck{X, (0, 1)) making this space 
a Polish group. 

Let Hyj be the subgroup of Ck{X, (0, 1)) generated by G^. By Pettis' Theo- 
rem [To], since Gw is non- meager and analytic, GwOGw has non-empty interior. 
Hence the subgroup is open, and so coincides with Ck{X, (0, 1)) (which is 
connected) . 

Set to be the finite set of $iS appearing in w, and set M' to be ©, and 
the finite set of elements of M appearing in w. Since i?^ = C(X, (0, 1)), each 
element of C{X, (0, 1)) is a composition of members of M' and C(R). 

We check is a finite generating* family with respect to M'. For if / G 
C*{X), then / maps into some open interval (a, 5). Fix a homeomorphism 
5o : R ^ R taking (0, 1) to (a, b). Then f ^ g^o [g^'^ o /), where g^^ o f is in 
Cfe(X, (0, 1)). Hence g^^^ o / can be expressed as a composition of elements of 

M' and some gi, . . . in C(R). But now / is go of this composition and 
so is also expressible in terms of elements of M' and C(R), as required. ■ 

We note that the finite generating* family is a subset of the original family, 
and also that if the original family is generating then we can take M' C M U 
{+,-}• 

Proof of 1) =4> 3). 

Let X be a space with a countable generating* family with respect to a count- 
able set of operations. By Corollary [6] a) X is separable metrizable. Lemma [8] 
then says that X is locally compact. From Lemma [9] we deduce that X has a 
finite generating* family. Hence by Corollary [6] b) X is finite dimensional. ■ 

3 Construction of Finite Basic Families 

This section is devoted to proving: 

Lemma 10 If X is a locally compact, separable metrizable space of dimensiosn 
< 71 then X has a basic family of size 2n -|- 1 . 

Lemma lTOl is the forward implication of the 'Further' claim in the Main Theorem. 
The implication '3) =^ 2)' of the Main Theorem then follows. 

Recall that Hattori [2 showed that every locally compact, separable metriz- 
able space X of dimension n has a finite basic* family of size 2n+l. Lemma [TOl 



5 



and its proof improves on Hattori's result and proof because: (1) it applies to 
all functions (not necessarily bounded), (2) it is constructive (Hattori's argu- 
ment uses a Baire category argument) and (3) it is considerably shorter than 
Hattori's. The proof is similar to that of Ostrand for compact metric spaces. 
However difficulties arise because continuous real valued functions on a locally 
compact space need not be bounded. 

For this section, fix a locally compact, separable space X of dimension < n, 
and with compatible metric d. We can find {Km : to > — 1} a countable cover of 
X by compact sets such that K^i = A'o = and K„i C K^_^_^ for each to > — 1. 
For each to > we put Hm — Km \ Km_i, and set Um = -f^m+i \ Km-i- Since 
Ostrand has done the compact case, we can assume that the Km^s are strictly 
increasing. We show X has a basic family of size 2n + 1. 

The basic functions <I>i are defined to be the limit of approximations fl- The 
approximations are defined inductively along with some families of 'nice' covers. 
These 'nice' covers come from Ostrand's [9] characterization of dimension: 

Theorem 11 (Ostrand's Covering Theorem) A metric space Y of dimen- 
sion < n if and only if for each open cover C of Y and each integer k > n + 1 
there exist k discrete families of open sets Ui, . . . ,Uk such that the union of any 
n + 1 of the Ui is a cover ofY which refines C. 

Lemma 12 Let 7 > 0. There are 2n + 1 many families S^, . . . ,5^"+^ of open 
subsets of X , and rj"^ > for to > 0, satisfying: 

(1) Each iS* is discrete in X. 

(2) For k fixed and each x^X fixed, \{S £ U?"^^ : x (z S}\> n + 1. 

(3) diamS < 7 for any S G U?"^^ S\ 

(4) [jflV refines {[/,„ : m e uj}. 

(5) For anym&n,{S:Sc U?"^ S\ S r\ Km ^ %} is finite. 

(6) S{Hm ^ri"") r\ S ^ ^ if Hmf^^ = ^ for any S e [f.^l S' . 

(7) S{Hm-i,r'-') n 5(i/„,+i, r;"+i) = 0. 

In (6) and (7), S{Hm, rT) ^ {x <a X : d{Hm,x) < r/™} 

Proof. Let C = {Ca : a G N} be a locally finite open cover of X with: 
diam (Ca) < 7 and \{Hm : Hm n Ca 7^ 0}| < 2, for each a S N. Then by 
Ostrand's covering theorem, there exist 2n + 1 discrete families of open sets 
>5i, • • • , •S2n+i which refines C. Also the union of any n + 1 of the Si is a cover 
of X. So l)-4) are easy to verify. 

Fix i with 1 < i < 2n + 1. As S' is discrete, {S : S n Km f!>, S & S'} is 
finite. Thus condition 5) is satisfied. 

Now fix i and to, the discreteness of 5* guarantees that 

Hm n |J{5 : SeS' and HmDS^d)}^ 9. 

So diHm,[j{S : S eS' and Hm nJS) = 0} > 0. Then we can pick such 
that SiHm,vr) n S* = if i?,„ n 5* = for any S G S\ Let 77" = min{?7™ : i = 
1, • • • , 2n + 1}. This satisfies 6). 
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Notice that since Hm is compact for each m G N, we can pick ry™ smah 
enough such that S{Hm-i,v'"'^^) n S{H„,+i,t]"'+^) = 0, giving (7). ■ 

Step 1: Construction of the approximations Again, we generahze the 
construction of Ostrand, but must find ways around the problem of not having 
bounded functions. 

By induction on A; > 0, using Lemma 1121 for z = l,...,2n+l, there exist: 
positive real numbers with ei < 1/4, 7^, 77™ distinct positive prime numbers 
r^, discrete families Sl, ...,5^"^^ and continuous functions f'j, : X ^ [0, k + 1], 
with the following properties. 

For each fc e N, the families 7^ and 77^' satisfy (l)-(7) of 

Lemma [T^ Further: 

(A) limfe_,oo 7fe = lim/c^oo Cfe = 0; 

(B) < i/n^:+V- 

(C) is constant on the closure of those members of 5^ which have nonempty 
intersection with K„i for (m < fc), the constant being an integral multiple of 
1/rj,, and takes different values on distinct members. Then we can take a con- 
tinuous extension of fl to the rest of the space. 

(D) For any S in SI having nonempty intersection with Hm, m~l < fln{S) < 
m+ 1. Also for m > 2, by (7), we can make m — 1 < fl{S{Hm, rf^) < to + 1. 
For each i e N, if_^ n 7?^ 7^ and 'S n 7?„,+i ^ 0, then to < /^(C) < to + l;if 
5 n 77„j 7^ and S" n ^ 0, then to, - 1 < /„(S')^ < to; 

(E) For each £ < j < k and x G Kg, f]{x) < fl{x) < f]{x) + ej — Cfe for any 

i. 

Step 2: Construction of the basic functions From (E), for any x £ Km 
and k > m, fmi^) < fl{x) < fmi^) + ^1 * — 1, • . . ,2n + 1. Thus 

we can take the uniform limit of fl restricted on Km- For any x e Km let 
^i{x) = limk^oo fl{x). So $j is continuous on Km for each to. Hence $i is 
continuous on X. Also by (D) for x S Hm, to — 1 < <i>i(a::) < to + 1 + 1/4. 
Let Vl = {MS) ■■ S e Sl}. Then if S n Km ^ 1^ and S e SI with fc > to, 
is contained in the interval [/|(S'),/|(S') + efe] by (E). By (B), these 
closed intervals are disjoint for each fixed to and k with k > m. Then each VI 
is discrete. 

Step 3: Construction of the coordinate functions Take any function 
/ e CiX). We find ffi, . . . ,52n+i e such that / = 9^°'^^■ 

For each s > 0, define the compact subset Ls = A's+i \ -f'^s-i- Since Ki is 
compact and Ki C there exists a function /i such that fi{x) — f(x) for 
a; G and /i (x) = for a; G X \ /4r| . Then letting 51 = / — /i , it is easy to 
see that gi{x) — for x & Ki. Similarly, there exists /2 such that f2ix) = gi{x) 
for X € K2 and f2{x) = for x G X \ K^. Inductively, / can be written as an 
infinite sum Y^^=i fs such that fs{x) = for x € X \ Lg. 

For each s, fs is bounded and uniformly continuous. Fix s G N. Note that 
for each x e Ls, s - 2 < ^i{x) < s + 2 + 1/4. 
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By construction, if we restrict the discrete families Si, - ■ ■ ,S2n+i and the 
functions $i, • • • , $2n+i to Ks+i, then the discrete famiHes and functions are 
exactly those defined by Ostrand [S]. 

In particular, the functions ^i\Ls, . . . , $2n+i|-^s are basic for (Lemma[5]). 
Thus we can represent fs\Ls{x) = Yl'iZV 9ii^i\Ls{x)), for some g| £ C(R). We 
can redefine gf to be constantly zero outside of [s — 2, s + 2 + 1/4] because the 
image of $i is contained in [s — 2, s + 2 + 1/4] and fs{x) = if a; G \ {Ls)° ■ 

Now /« = E-:^\i°*.- ^ 

Finally, letting gi = X]s=i that gi is continuous because gi{x) is a 

finite sum of non-zero continuous fimctions for each a; £ M, and / = Y^'fZt^ gi°^i 
— as required. ■ 



4 Characterization of Dimension 

Lemma [To] says that a locally compact, separable metrizable space of dimension 
< n has a basic family of size < 2n + 1, giving the forward implication in the 
'Further' of Theorem H) For the converse: 

Lemma 13 A space X with a basic* family $i, . . . ,$Ar, where N < 2n + I, 
has dimension < n. 

Proof. Take any compact subset K oiX. By Lemma[71 the maps ^i\K, . . . , ^n\K 
form a basic* family for K, hence by compactness a basic family. By Sternfeld's 
result connecting dimension and basic families in compact spaces, it follows that 
dimiiT < n. 

By Lemma m X is locally compact, separable metrizable. Hence it has a 
locally finite cover by compact sets - each, by the above, of dimension < n. By 
the Locally Finite Sum Theorem for dimension, we deduce that X itself must 
have dimension < n. ■ 
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